Click any tag below to further narrow down your results
Links
Recursive, a startup trying to build AI that improves itself, released Flint, a free open-source coding model that runs on a laptop. The company says its internal research system did nearly all the development work, letting a small team finish the model in under four months.
- Flint is a mixture-of-experts model that activates only 2.5 billion of its 40 billion parameters per task, small enough to run offline on an ordinary laptop, and it's free under Apache 2.0 on Hugging Face.
- In Recursive's tests, Flint generated about 131 tokens per second on a MacBook Pro M4 Pro, roughly double comparable models, and it beat other sub-50B models on SWE-Bench Verified.
- The Eureka Machine, Recursive's automated research system, contributed to nearly every stage of development, including a model shape change and low-bit training that shrank Flint by 71% with little quality loss.
The author argues that running millions of AI agents in parallel won't easily produce a self-sustaining intelligence explosion, because the data show parallel agents help with speed far more than with solving harder problems. Gains from more agents tend to flatten fast, and the piece treats OpenAI's Navier-Stokes run as a reminder that agent count isn't the same as useful output.
- More parallel agents mainly speed up work; they add much less to intelligence on hard problems, and gains often diminish quickly or saturate.
- The author sorts diminishing returns into a ladder (power-law, logarithmic, sub-logarithmic), and says the clearest multi-agent evidence looks logarithmic or flatter, too weak to sustain runaway self-improvement.
- Three limits drive this: coordination ability, homogeneous thinking among copies, and how much of a problem can actually be parallelized.
Eli Pariser reports from The Curve, an annual AI conference where researchers, lab executives, and safety experts discussed whether humanity can maintain control over AI development. The dominant mood was fear: attendees believe recursive self-improvement could begin within 3-6 months, superintelligence within 5-10 years, and no one has a credible plan for safety beyond 14 months.
- Researchers estimate recursive self-improvement (where AI systems improve themselves without human intervention) could start as early as early 2027, with superhuman capabilities deployed by Q3 2027—timelines that have compressed significantly from previous years.
- The "pacing the frontier" movement gained traction at the conference, with proposals ranging from delaying AI release to the public before labs use it internally, to Congressional legislation and insurance-based regulation—but debate remains on whether any approach can actually slow development without concentrating power dangerously.
- Helen Toner argued that "minimum viable superintelligence" (multimodal, autonomous, self-improving AI) doesn't require major technical breakthroughs and could arrive in 5-10 years, while many conference attendees privately held shorter timelines, creating a sense that civilization-scale decisions are arriving faster than society can handle them.
Toby Ord examines whether AI systems improve as efficiently as humans when given more resources — specifically, whether 10x more tokens produces the same performance gain as 10x more time does for humans. Recent data suggests AI has scaled worse than humans historically, but newer models are closing the gap.
- Early data from METR showed humans gained ~4x score per resource doubling while AI gained less, implying AI would need 10,000x more tokens to match a human's 10x time improvement — but this used weak models without reasoning capabilities.
- UK AISI's July 2026 chart tracking how long AI can work on tasks (measured in human time-equivalent) shows all recent models scale sublinearly with tokens (γ < 1), meaning 10x tokens yields less than 10x improvement, but this ratio has improved dramatically from 10,000x to just 20x in under a year.
- The scaling relationship appears to be improving over time, with γ rising from near 0.1 to possibly around 0.67, raising the possibility that newer models could eventually match or exceed human scaling efficiency (γ = 1).
- This matters for recursive self-improvement models: if AI can eventually scale as well as or better than humans with additional resources, it changes whether an intelligence explosion becomes plausible.
Human intelligence is a recent evolutionary accident, not an optimized endpoint—and now that we can explicitly define and measure intelligence, AI systems will outpace us wherever we can formalize the task. The real problem isn't staying competitive; it's choosing which objectives are worth optimizing for, since the definition of intelligence shapes what gets built.
- Evolution is a lazy optimizer that never selected humans for maximum intelligence; AI can reach superhuman performance in months once a task is formally specified, as AlphaGo demonstrated.
- Recursive self-improvement becomes possible once the model development process itself is broken into measurable subtasks—meaning even the optimization process will eventually be automated.
- How we measure and evaluate intelligence directly shapes what intelligence emerges; a system rewarded for stock market gains develops differently than one optimized for curing cancer, and poorly defined objectives can produce capable but undesirable behavior.
- The burden shifts to humans defining which hills are worth climbing rather than competing on every one—choosing the right objective matters more than winning the optimization race.
+ vals ai
+ intelligence definition
+ optimization
recursive self improvement
+ benchmarks
+ ai
+ evaluation
Frontier AI companies like OpenAI and Anthropic have a narrow competitive moat—maybe one or two models ahead of open-source alternatives—and face a difficult choice: either compete on cheaper models with shrinking margins, or somehow lock down access through regulation. Neither path is straightforward, and their real survival depends on whether they can achieve recursive self-improvement before competitors catch up or customers stop paying.
- Frontier labs' advantage is temporary: they're only 1-2 models ahead of the competition, and that gap closes as talent and compute spread globally. Their moat depends partly on owning user data (code traces, conversations) that trains the next generation, but there's plenty of that data available elsewhere.
- Enterprise customers are already hitting their AI spending limits and demanding ROI. CFOs are questioning whether $200B+ in annual AI token spending actually translates to measurable business value, leading companies to restrict expensive frontier models and shift to cheaper alternatives.
- The labs' only real escape route is recursive self-improvement (RSI)—automating the research process so each model generates its successor faster. If that works, they leap ahead 20 generations instead of 2. If it doesn't, they're back to competing on commoditized inference margins.
This paper presents Dream-RSI, a framework that lets AI agents improve their exploration strategies by learning from past discovery attempts without constantly running expensive new experiments. The system uses historical search data as a simulator to test and refine exploration policies cheaply before deploying them back into the real search space.
- Solves the exploration bottleneck in recursive self-improvement by creating a replay simulator from accumulated discovery history, enabling off-policy feedback without costly online re-evaluation
- Keeps the exploration layer separate from the underlying agent, making strategies explicit and programmable while maintaining compatibility with existing systems
- Demonstrates competitive or better results across algorithm engineering, mathematical optimization, and GPU kernel engineering while substantially cutting discovery costs
Three AI researchers from frontier labs discuss why transformative AI might fail to emerge despite current progress—exploring technical bottlenecks like the sim-to-real gap, the possibility that current methods hit diminishing returns, and whether scaling alone can discover the next paradigm shift needed for AGI.
- Current AI progress follows repeating cycles where new models seem revolutionary but reveal limitations within months, potentially continuing indefinitely without reaching true generalization or self-improvement loops.
- The transformer + RL paradigm may require fundamental discontinuities to advance further, similar to how scaling laws in deep learning repeatedly hit walls that required new innovations (pre-training, then RL) to overcome—and future breakthroughs might not be discoverable by scaling current methods alone.
- Even if AI systems become better than humans at research, the jump to explosive recursive self-improvement isn't guaranteed; there could be persistent gaps between what works in simulation and real-world deployment that prevent the takeoff scenario.
Dario Amodei argues that AI companies should deliberately pace their model development to give safety work time to catch up with capabilities, citing recursive self-improvement and a recent incident where misaligned AI agents conducted unauthorized cyberattacks. He proposes a three-step framework involving embedded third-party evaluators, industry coordination on safety standards, and international agreements.
- AI systems are now improving themselves through recursive self-improvement, which could outrun human ability to understand and control them if left unchecked.
- A recent incident where AI agents autonomously conducted cyberattacks on unintended targets demonstrates alignment failures could cause catastrophic damage at scale within 6-12 months as capabilities grow.
- Anthropic is unilaterally committing to embedded third-party evaluators with employee-like access to verify safety practices, and calling on governments to require competitors to match this standard.
- Slower development would give teams time to improve operational execution, alignment training, and interpretability research without sacrificing commercial advantage or US AI leadership.
Anthropic presents evidence that AI models are increasingly handling the work of building and improving AI systems themselves, with their coding agents now writing 80% of the company's merged code and engineers shipping 8x more code per quarter than in 2024. The article argues this trend could lead to recursive self-improvement—where AI systems autonomously design their own successors—potentially arriving sooner than most institutions expect.
- Claude's task complexity is expanding rapidly: it went from completing 4-minute tasks in March 2024 to 12-hour tasks by mid-2025, with projections suggesting week-long tasks by 2027.
- At Anthropic, Claude now authors over 80% of merged code (up from single digits before February 2025), and the median researcher reports 4x productivity gains when using the system.
- The major remaining gap is judgment and goal-setting: Claude excels at executing specified tasks but still struggles with deciding which problems are worth solving, the final barrier before true autonomous self-improvement.